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Abstract 

Background: Researcher-stakeholder collaboration has been identified as critical to bridging research and health 
system change. While collaboration models vary, meaningful stakeholder involvement over time ("integrated 
knowledge translation") is advocated to improve the relevance of research to knowledge users. This short report 
describes the integrated knowledge translation efforts of Connections, a knowledge translation and exchange 
project to improve services for women with substance abuse problems and their children, and implementation 
barriers and facilitators. 

Findings: Strategies of varying intensities were used to engage diverse stakeholders, including policy makers and 
people with lived experience, and executive directors, program managers, and service providers from Canadian 
addiction agencies serving women. Barriers to participation included individual (e.g., interest), organizational 
(e.g., funding), and system level (e.g., lack of centralized stakeholder database) barriers. Similarly, facilitators included 
individual (e.g., perceived relevance) and organizational (e.g., support) facilitators, as well as initiative characteristics 
(e.g., multiple involvement opportunities). Despite barriers, Connections' stakeholder-informed research efforts 
proved essential for developing clinically relevant and feasible processes, measures, and implementation strategies. 

Conclusions: Stakeholder-researcher collaboration is possible and robust integrated knowledge translation efforts 
can be productive. Future work should emphasize developing and evaluating a range of strategies to address 
stakeholders' knowledge translation needs and to facilitate sustained and meaningful involvement in research. 

Keywords: Integrated knowledge translation, Stakeholder-informed research, Addiction services, Women, 
Service providers, Policy-makers 



Background 

Researcher-stakeholder collaborations are considered 
critical for addressing continuing gaps between research 
and health system change [1]. Following in the tradition 
of participatory research, it has been argued that for sys- 
tem change to take place knowledge-users, including 
front-line practitioners, organizational decision-makers, 
policy- makers, service users, and other stakeholders 
need to be meaningfully involved with the research 
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process from project development initiation, and have 
genuine opportunities to influence project design, pro- 
cesses, and outputs [1]. Often referred to as "integrated 
knowledge translation", (iKT) this approach has received 
increased funding agency attention and many grants 
require applicants to include iKT plans [1]. Recent iKT 
attention stems from acknowledgement that barriers 
to implementing evidence-based practice arise from re- 
search innovation characteristics, including its perceived 
relevance to and compatibility with existing practice, as 
well as its feasibility and effectiveness with 'real' clinical 
populations (for a review see [2]). By integrating stake- 
holders into the research process, it is expected that the 
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feasibility and relevance of the knowledge and products 
generated will be enhanced [1,3] and uptake improved. 
Indeed, emerging evidence supports the potential utility 
of iKT in developing knowledge and products perceived 
as relevant [4] and in promoting uptake of evidence- 
informed practices and policies [5]. Accordingly, this 
article describes the use of iKT strategies throughout the 
design and implementation of a Canadian knowledge 
translation initiative focused on enhancing the use of 
evidence-based practice in services for women with sub- 
stance use issues and their children. 

Notably, while there has been some early evidentiary 
support for iKT, there is a continuing need to ope- 
rationalize iKT [6]. Kothari and Wathen define iKT as "the 
development of a relationship between academic re- 
searchers and practitioners and/or policymakers for the 
purposes of collaboratively engaging in a mutually benefi- 
cial research project or programme of research" [7]. While 
this highlights some key iKT aspects, it does not identify 
which strategies and activities constitute iKT, nor how to 
achieve its goals. Some iKT-related activities that have 
been proposed include information sharing, meetings, 
and joint task completion, including developing research 
questions and designs, data collection planning and imple- 
mentation, data analysis and interpretation, and recom- 
mendation generation [7-11]. These activities overlap with 
the aims of participatory research, although iKT is more 
focused on integrating the end users of the knowledge 
being created as opposed to individuals affected by the 
issue under investigation more broadly (e.g., patients) and 
participatory research requires stakeholder participation 
throughout whereas a range of iKT activities can be con- 
sidered acceptable depending on what is considered ne- 
cessary to move the research to practice [1,12]. 

Like participatory research and other forms of commu- 
nity-based research, however, iKT efforts can be hampered 
by many collaboration challenges. For example, the time, 
effort and resources required to meaningfully participate 
in collaborative research can exceed what is feasible, 
especially for individuals for whom research is not consi- 
dered part of their typical role, such as service providers 
[7,10,11]. Also, differences in expected pace and timelines, 
particularly the short, demanding timelines of some grant 
applications and the slow pace of results generation can 
lead stakeholders to feel their needs have not been met 
[10,11,13,14], Moreover, stakeholders may enter collabora- 
tions with priorities, goals, and expected benefits that dif- 
fer substantially, and which may be met to varying 
degrees. To the extent that priorities, goals, and expected 
benefits are unmet, stakeholders may reduce or restrict 
their further involvement, limiting the potential benefits 
originally intended by the collaboration [7]. Organi- 
zational factors also can impact collaboration success. 
Staff turnover, organizational culture, especially differing 



views of evidence', and variations in accountability and 
reward systems can hamper functioning of stakeholder- 
researcher partnerships [7,10,11,13-18]. 

Connections is a research program dedicated to deve- 
loping and evaluating knowledge translation and exchange 
(KTE) strategies to facilitate evidence-informed decision- 
making in women's services for substance abuse issues 
[19]. Given the Connections Research Team's interest in 
developing relevant and feasible strategies for enhancing 
evidence-based practice, the use of iKT strategies was con- 
sidered essential. In addition to expanding knowledge 
about factors affecting KTE success in the addictions sec- 
tor, Connections conducted a multi-site feasibility study of 
a knowledge broker intervention to enhance evidence- 
informed decision-making. From the outset, the Connec- 
tions Research Team emphasized iKT and over the 5 -year 
initiative multiple iKT strategies were utilized. In this short 
report, we describe the strategies used, barriers and facili- 
tators, and implications for future iKT efforts. 

Methods 

Connections 

The Connections Research Team includes 13 multidiscip- 
linary researchers from across Canada with varying areas 
of expertise, including KTE, health (women's, children's), 
addictions, treatment evaluation, biostatistics, research 
methodology, qualitative research, and network analyses. 
During the grant development phase a National Advisory 
Committee of key stakeholders, including individuals 
with lived experience, was developed to provide ongoing 
consultation. Our primary iKT goal was to enhance our 
shared understanding of stakeholders' KTE preferences, 
evidence-informed decision-making processes, service in- 
tegration, cross-sectoral networking (e.g., women's ad- 
dictions, adult mental health, children's services), and the 
clinical needs of women and their children. We aimed to 
achieve this by developing a sense of belonging to a 
collaborative inter-professional community dedicated to 
improving access to evidence-informed care within the 
addictions sector for women with substance abuse prob- 
lems and their children. 

Procedure 

Executive directors, program managers, and front line 
staff from addiction agencies serving women and indivi- 
duals with lived experience, administrators, policy makers, 
and representatives from other relevant local, provincial, 
and national organizations were invited to participate in a 
range of opportunities grouped into three main strategic 
approaches: 1) Information sharing (e.g., website, media 
press releases, conferences, and other presentations); 2) 
Informal input-seeking (e.g., individual consultations, re- 
quests for written feedback); and 3) Formal input-seeking 
(e.g., surveys, semi-structured individual interviews, focus 
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groups, networking events, National Advisory Committee 
meetings, and Research Team meetings). 

Findings 

Over 2000 stakeholders participated via two surveys 
(n = 1800), three focus groups (n = 24), four networking 
events (n = 111), five National Advisory Committee 
meetings (n = 25), and three studies involving individual 
interviews (n = 81). In addition, the Connections' website 
received over 10,000 hits, we published 14 papers, se- 
veral hundred people attended our 24 conference pre- 
sentations and/or provided input in response to email 
consultation requests. We also trained 14 students. 

Barriers 

Through team member observation of patterns of par- 
ticipation, and stakeholder feedback that was either 
formally sought (e.g., at networking events) or informally 
received (e.g., individual email response to a request), we 
noted a number of barriers to stakeholder participation. 
At the individual level, stakeholder involvement was 
affected by lack of time, clinical demands, lack of inte- 
rest, and lack of perceived expertise to make valuable 
contributions. At the organizational level, resource con- 
straints, agency and funder priorities, and staff turnover 
presented barriers to participation. At the system level, a 
lack of a centralized stakeholder database to facilitate 
identification of relevant stakeholders hampered iKT 
efforts. 

Connections' response to barriers 

Connections' efforts to ensure wide stakeholder participa- 
tion led to the development and implementation of spe- 
cific strategies to address barriers. For example, in order 
to address challenges associated with resource limitations, 
Connections provided free capacity building and networ- 
king events, provided financial support for travel to bring 
stakeholders together, and provided backfill support to 
agencies for staff participation. In addition, in response to 
stakeholder input, Connections held some of their events 
to coincide with other events that stakeholders typically 
attended, e.g., national substance abuse conferences, redu- 
cing the travel burden and leveraging existing networking 
opportunities. Lastly, Connections provided a range of 
opportunities for stakeholder involvement, reflecting the 
diversity of interest levels and capacities for participation 
expressed by stakeholders. The selected strategies ranged 
in the time, effort, and resources required to implement 
and to participate, the number of stakeholders who could 
feasibly be involved, and the breadth and depth of in- 
formation that could be gathered. Surveys, for example, 
provided a relatively low resource-intense mechanism for 
gathering a broad range of information from a wide range 
of stakeholders at repeated points in time. Networking 



events and interviews, on the other hand, afforded oppor- 
tunities to gather detailed information about a narrower 
range of issues from a smaller stakeholder group. 

Facilitators 

Like with barriers, formal and informal stakeholder feed- 
back and team observations revealed a number of facili- 
tators of stakeholder participation. At the individual level, 
perceived clinical need and relevance of improving ser- 
vices to women with substance abuse issues and their chil- 
dren was considered to be a key driver to stakeholder 
involvement. For example, stakeholders viewed Connec- 
tions as promoting the collaboration and networking re- 
quired to improve service delivery to women whose needs 
are often complex and multi-faceted, and as enhancing in- 
tegration of research knowledge and practice experience, 
which they considered essential to improving outcomes 
[20]. At the organizational level, resource support pro- 
vided by Connections to agencies, including free capacity- 
building events, travel sponsorship, online literature data- 
base access, and back-fill funding, provided much needed 
support to facilitate participation. At the iKT intervention 
level, stakeholders identified Connections' flexible mul- 
tifaceted approach with opportunities for involvement that 
varied in intensity and resource requirements, its utili- 
zation of local experts and leads, its multi- disciplinary 
team and advisory committee, and its overall collaborative 
approach to be essential components promoting stake- 
holder participation. 

Impact 

The impact of stakeholder involvement on Connections' 
research was substantial. Resulting from stakeholder input, 
Connections' originally proposed processes, measures, and 
interventions were kneaded into stakeholder-informed 
processes, measures, and interventions considered highly 
relevant and feasible to clinical settings. For example, the 
planned KTE intervention study did not originally include 
a knowledge broker but in response to stakeholder feed- 
back, we altered the planned intervention to include 
a 12-month trial of a Connections' knowledge broker 
providing on-the-ground' support to enhance evidence- 
informed decision-making knowledge, attitudes, and skills 
to 15 agencies across Canada. Further, the study did not 
originally include providing subscriptions to online data- 
bases but in response to stakeholder discussions about 
their access to evidence, our intervention expanded to 
include providing subscriptions to online databases of 
research evidence to each participating agency. Moreover, 
clinically relevant research questions raised by stake- 
holders and for which sufficient evidence does not exist 
have become the basis of further research funding 
proposals. 
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Notably, different iKT strategies were found to have 
varied effects. Among the formalized approaches, those 
primarily quantitative strategies that reached a larger 
number of stakeholders across a wider range of areas of 
inquiry (e.g., surveys) resulted in broader stakeholder rep- 
resentation and greater diversity of perspectives. Those 
strategies that were narrower in scope, such as individual 
interviews, provided better issue representation with spe- 
cific areas of inquiry explored in detail but fewer perspec- 
tives could feasibly be explored. In combination, however, 
these strategies allowed the team to forge a greater un- 
derstanding of the range and complexity of KTE-related 
issues that needed to be addressed to enhance research on 
evidence-informed decision making among service pro- 
viders working with women with substance abuse issues. 

Although many stakeholders had sporadic or single 
episode involvement, other stakeholders had ongoing 
involvement over the 5 -year project. Indeed, for some 
stakeholders, their roles shifted from initial low intensity 
involvement (e.g., providing ad hoc consultation) to 
higher intensity roles, such as local lead at a study inter- 
vention site. These experiences highlighted the potential 
for long-lasting meaningful stakeholder-researcher colla- 
borations to function despite the barriers, and empha- 
sized their role in promoting successful KTE. 

Limitations 

We did not set out to systematically study our iKT activ- 
ities and as a result, our methods for tracking barriers and 
facilitators, particularly those identified through informal 
feedback, were somewhat limited. In addition, the stake- 
holders who participated were not necessarily representa- 
tive of all members of their stakeholder groups. Future 
studies of iKT efforts should endeavor to gather infor- 
mation systematically about both participating and non- 
participating stakeholders. 

Implications 

Connections' iKT experiences underscore the need to de- 
velop and evaluate a broad range of iKT strategies, and 
suggest that the inclusion of a wide range of activities 
within the iKT definition e.g., [7-11] is warranted. As has 
been suggested by Kothari & Wathen (2013), limited 
stakeholder time and resources pose significant collabo- 
ration challenges. Despite these and other barriers, how- 
ever, iKT is feasible and for Connections, iKT contributed 
meaningfully to project processes and outcomes. Multi- 
pronged approaches that offer flexible opportunities for 
involvement and that respond to stakeholders' needs, such 
as those used by Connections, appear essential for pro- 
moting sustainable iKT. Moreover, resources dedicated to 
supporting meaningful and sustained stakeholder involve- 
ment are critical if enhanced researcher-stakeholder col- 
laboration is to become commonplace and maximally 



effective [7]. Indeed, service funders, like researcher flin- 
ders, may need to consider allocating resources to support 
stakeholder-researcher partnerships in the pursuit of rele- 
vant and usable clinical knowledge. 

Notably, limited attention has been paid to systemi- 
cally documenting the cost to stakeholders of their col- 
laboration in research. In addition, little information 
exists about the effects of iKT on stakeholders' research- 
related knowledge, attitudes, and practices, as well as re- 
searchers' understanding of real world' service delivery 
contexts and integration of stakeholder input into pro- 
ject design and processes. Future research should ad- 
dress these gaps. 

Conclusions 

Effective use of iKT strategies is possible and recom- 
mended. In order to develop meaningful collaborations, it 
is suggested that researchers consider potential barriers as 
well as strategies to overcome barriers and facilitate stake- 
holder involvement early in the project planning and 
funding application process. Multi-method approaches for 
stakeholder involvement must be considered and eva- 
luated. Also, iKT efforts and stakeholder responses must 
be systematically documented. Lastly, greater attention 
needs to be paid to understanding which engagement 
strategies work best for which stakeholders, for what pur- 
pose, and with what level of effectiveness. 
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